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ABSTRACT 

The Questioning Strategies Observation System (QSOS) 
is designed to record verbal behaviors occurring in the classroom 
which are associated with the teacher's use of questions. Twenty-four 
categories are used in three main sections: initiation of the 
question, response to the question, and reaction to the response. 
Under initiation, the categories first designate the pupils expected 
to answer (MDES, mass designated; NDES, no one designated; GDES, 
group designated, and IDES, individual designated), and secondly 
identify the question's cognitive level (knowledge, comprehension, 
application, analysis, synthesis, evaluation, affectivity, and 
procedure). Two additional types of question are probing and 
redirecting, intended to elicit additional resoonses. The response 
categories are: designate (the response is the expected one) , 
independent (pupils respond without being called on by the teacher) , 
intercepted (a pupil other than the one called on responds) , aborted 
(something interferes to prevent a response), and no response (the 
question fails to elicit any response). Feaction categories are: 
approval, acceptance, rejection, criticism, and no evaluation. This 
version of QSOS was developed for a specific research project and 
does not include categories for pupil initiated questions or textbook 
or prefraned guestions. These will be included in a more fully 
developed version. (MDM) 
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THE QUESTIONING STR/ T2GIES OBSERVATION SYSTEM (QSOS) 



Kevin R. Morse 
0,L. Davis, Jr. 



The Questioning Strategies Observation System (QSOS) is designed 
to record verbal behaviors occuring in the classroom setting which 
are associated with the teacher's use of questions. Twenty-four 
separate categories are included in the system to describe component b 
of the questioning interchange. 

In recent years, a host of systems have been developed to record 
classroom Interaction objectively. Beginning with Anderson and Brewer 
(1945) and continuing to the present time, systems designed to record 
various aspects of classroom behavior have evolved. Each system was 
developed for the purpose of recording selected dimensions of the 
instructional environment . Notable among these have been Withall' s 
(1949) measure of eocio-emotional climate, Flander's (1965) interaction 
analysis, and the OScAR (Medley and others, 1968). These three 
systems represent efforts to identify and categorize selected class- 
room behaviors for tho purpose of deriving measures designed to represent 
some global aspect of teacher pupil relationships. 

The primary concern of the major systems now being used (e.g., 

OScAR, Flanders) has been rather gross dimensions of the classroom 
environment. These systems attempt, through analysis of behaviors 
abstracted and quantified, to provide a "picture" of the classroom 
climate for pupil learning. This "picture" subsequently can be used 
for a number of purposes such as to provide data for research comparisons 
and to serve as a means for providing feedback to teachers regarding 
their teaching behaviors. 
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A major decision in developing a system for observing classroom 
behavior is the limitation of the number of behaviors to be recorded. 
Each system should be designed, in effect, to include only;those 
behaviors which directly contribute to the classification of events 
relating to the principal focus of interest, for this reason, no 
system attempts to include all or even most of the behaviors that 
take place in the course of an observation period. 

The Questioning Strategies Observation System (QSOS) focuses on 
those behaviors, primarily of the teacher, which have been identified 
as being associated with classroom questioning. A number of systems 
or fcruiAts have been designed to record selected questioning behaviors 
(e.g., Adams, 1964 ; Davis and Tinsley, 1967; Floyd, 1960; Guzak, 

1967; Harris and McIntyre, 1964; Rogers, 1969). Other systems 
(e.g., Flanders, OScAR) include categories for certain questioning 
behaviors. None of these, however, encompasses the range of behaviors 
included in the QSOS. 

The present version of the QSOS was developed for a specific 
research project in a Teaching Laboratory setting (Morse, 1969) and 
is the latett development in a continuing research interest on 
classroom questioning behavior (Davis, Morse, Rogers, and Tinsley, 
1969). Consequently, several categories of questioning strategies 
were not included. Such categories (e.g., pupil initiated question, 
textbook or preframed questions) can be added to the basic format 
and will be components of a more fully developed QSOS to be issued 
later* 
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Design of the QSOS 

Tlie design of the QSOS is based on the conception of questioning 
strategies as composed of interchanges between teacher and pupils 
which consist of initiating, responding, and reacting. This conception 
clearly relates to the work of Bel lack and others (1966). Initiation 
is that component of the interchange by which the teacher attempts to 
elicit pupil responses by formulating questions and directing them 
to (a) pupil(s). Response Is the behavior (s), or absence of behavior, 
of pupils subsequent to the teachers initiation -- the attempt to 
initiate the interchange. Reaction is the manner of the acknowledge- 
ment of teacher f s pupil responses and constitutes the completion of 
the interchange. In typical strategies of questioning, a number of 
interchanges occur, generally in rapid succession. 

Each interchange in the classroom setting is categorized four 
times in the same column on the QSOS form. The observer first 
categorizes the teacher f s initiation question on the basis of how it 
was directed to the class, by marking one of the first six categories. 
The second categorization identifies the cognitive level of the 
question and is marked in one of categories seven through fourteen. 

The third categorization notes the type of pupil response to the 
question and includes categories 15 through 19. The last categoriza- 
tion of an interchange records the teacher's reaction to the pupil 
response and uses one of the final five categories of the system. 

The resulting record of questioning Interchanges during an observa- 
tion preserves sequences as well as provides frequencies cf occurance 
of events . 
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QSOS Categories and Definitions 

Initiation , Interrogative statements made by teachers intended 
to elicit a response from (a) pupil(s) initiate a questioning inter- 
change. Rhetorical questions, under this rule, are excluded from 
QSOS classification. Two sets of QSOS categories are utilized to 
record these initiation questions. The first notes the teacher Vs 
designation of (the) pupil (s) expected to answer the question. The 
second set of categories identifies the question's cognitive level 
(Bloom, 1956) or notes affectivity or procedure if the question does 
not have cognitive orientation. All recording begins with teacher 
questions . 

MDBS Mass designated . The entire class is expected to respond 

to the question. Used often in drill, especially by 
language and mathematical teachers. Examples: 

"Who was our first president?" (Whole class responds.) 
"Como esta usted?" (Class responds, M Muy bien, gracias. 11 ) 
KDES No one designated . Teacher offers question to entire class 

without indicating who should respond. Pupil answers 
independently. Example: 

"Who invented the light bulb?" (John raises hand.) 

"John?" 

CDES Group designate d. First , teacher offers question to entire 

class, then calls on specific pupil to respond. Example: 

"Why did the candle go out?" "John?" (John responds.) 
IDES Individual designated . First teacher calls on pupil, then 

asks question. Example: 

"John. Why did Benjamin feel alienated?" 

Two categories of questions which my initiate an interchange 
but do not elicit initial responses are probing and redirecting . 

Questions in these categories are used to continue to elicit pupil 
response . 
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PROB Probing . Calls on the same pupil responding to the previous 

question to extend, clarify, or justify initial response. 
Examples : 

"Can you add to that, John? 11 

"Why do you answer that way?" 

REDR Redirecting . Calls on different pupil to react to response 

of first pupil. Examples: 

"Do you agree with him?" 

"How would you answer that?" 

When a question has been categorized into a designation category, 
it is also classified into one of the following eight c.itegories. 

This set rilates to the intellectual process most likely required Of 
the pupil in his formulation of a response or to whether the teacher 
expects the pupil to deal with his attitudes or feelings or a class- 
room procedure. 

KNOW Knowledge . For purposes of observation and recording, 
perhaps easiest is to think of knowledge as a situation 
requiring memory. In most instances, this category records 
requests for the recall of specific information. Though 
the type of information called for may vary, the process 
is basically one of calling to mind some previously known 
bit of information. 

Examples : 

"John, how is the Pythagorean theorem stated?" 

"What were the five major contributing causes of the 

American civil war?" 

,r What did we decide upon as the reason Poe wrote 

’The Raven* 2" 

COMP Comprehension . This category represents the lowest level 

of cognitive understanding. Pupils who demonstrate compre- 
hension can. translate a communication from one form to 
another. They can interpret by reordering or rearranging 
a communication or generally demonstrate the ability to 
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grasp the thought of a word* They can predict or extrapolate 
trends or tendencies* Examples: 

"What does ’From each according to his ability, to 
each according to his needs 1 mean to you?" 

"In your own word-*, how would you explain a simile?" 
"What are the possible consequences of the pollution 
of our air and water supplies?" 

APPjj Application * Here pupils use abstractions in particular 
and concrete situations, in a sense, the ability to 
generalize. Examples: 

"What will happen if we place a glass over this 
lighted candle?" 

ANAL Ana lysis . Pupils breakdown a communication, verbal or 

written, into its constituent elements or parts so as to 
distinguish clearly what ideas are being expressed. 

Examples : 

"What is the author of this editorial cartoon 
attempting to make us believe?" 

"How does the candidates written work compare with 
his public statements?" 

"What is the pattern and form used in this painting 
in your judgment?" 

SYN > :: . 8yrtthesla * Pupils combine discrete elements to form a 

whole. Also, pupils demonstrate their ability to write or 
speak in an effective, organized manner and/or to discover 
and generalize from experience* Examples; 

"How would you test to see whether decomposition 
always occurs under these conditions? 11 
"How would you relate to us that experience if you 
wanted to impress us?" 

"What would you guess was the cause of this phenomenon 
and how could you find out if you were right?" 
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£VAL Evaluation . Pupils make judgments about the quality of a 

procedure or materials for certain specified purposes. 

They assess something on the basis of a set of criteria. 
Examples: 

"From a scientific standpoint how reliable were the 
results obtained by Newton in his early experiments 
with motion? 11 

"How well does Picasso represent the school of 
modern, impressionistic ?rt?" 

"Is the argument used by the anti-floridation people 
in this editorial valid or invalid?" 

AFEC Af fectlvlty * This category includes questions that deal 
with pupil opinion, attitudes, feelings and beliefs. 

These questions do not demand a demonstration of any kind 
of knowledge or skill. Examples: 

"Did you enjoy reading the chapter on communication?" 
"What do you think about the war on poverty?" 

"Was the homework extremely difficult?" 

P-ROC Procedure , This category deals with classroom organization^ 

routine, or management. Examples: 

'’What page are we on?" 

"Who did question four correctly?" 

"Is the back window open?" 

Response . Pupil(s) responses are classified on the basis of 
whether the questions asked were answered as expected or in some 
other way. The correctness or adequacy of the response is not a 
factor of consideration. The five categories used to record responses 
are : 

QES Designated. Whether or not the question was mass, group, or 

individual designated, the response is the expected one. 

The designated person or group respond?. 
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IND In dependent . A pupil or group volunteers response independently, 

that is without being called upon by the teacher. Pupils 
who raise their hands and are then called upon ere considered 
to have responded independently. 

INT Intercep t . This response occurs when e pupil ocher then 

the one called upon responds or when the teacher answers 
the question himself. 

NOR No response . The teacher's question fails to elicit (a) 

pupil(s) response. 

ABT Abort . Teacher asks question but something interferes 

with the interchange which displaces a response. Such an 
event might be an irrelevant pupil comment, a class inter- 
ruption, or other unanticipated occurrence. 

Reactions . The teacher's means of acknowledging pupil responses. 

Reactions can be positive or negative, depending upon bpth the inferred 

intent of the teacher and the effect(s) on the pupil, Categories of 

reaction are: 

NOEV No evaluation . Teacher dpes not react directly or personally 

to pupil response. 

AFPR Ap proves . Teacher approves of pupil response. Examples: 

"Very good." 

"Well done." 

"That's what I wanted." 

ACC Accepts . Teacher accepts pupil response. Examples: 

"Right." 

"Okay." 

REJ Rejects . Teacher rejects pupil response. Examples: 

"No." 

"Wrong." 

"That r s not the correct answer." 

CRIT Criticises . Teacher criticises pupil. Examples: 

"That *8 not right at all." 

"You know better than that." 

"That's a terrible answer." 



9 



Some Measures Yielded by QSOS 



For the purpose of analyzing the questioning behaviors of teachers, 

QSOS measures may be derived several, ways* Frequencies of category 
events may be summed for each category separately. In addition, 
frequencies of events in two or more categories may be summed. Another 
procedure may include a count of categories in a a^et In which events 
have been recorded. Seven special measures have been developed and 
used in research (Morse, 1969). Other measures are under consideration 
and may be included in subsequent versions of this manual. The seven 
messures and their definitions are: 

(a) Question Quantity : The sum of all frequencies in all 

categories of teacher questions (MDES + IDES + GOES + 

NDES + PROB + REDR) . 

(b) Cognitive Quantity : The percentage of teacher questions 

which are categorized as cognitive (KNOW + COMP + APP1, + 

ANAL + SYN + EVAL) + (KNOW + COMP + APPL + ANAL + SYN + 

EVAL + AFEC + PROC). 

(c) Cognitive Quality : Weights are assigned to the six cognitive 

categories: KNOW - 1; COMP m 2 ; APPL - 3; ANAL - 4; 

SYN *= 5; EVAL = 6. The frequency of events in a category 
is multiplied by its weight. AH resulting products are 
summed and an arithmetic mean calculated. The resulting 
mean is the score for cognitive quality. 

(d) Tactical Versatility : A count of the total number of QSOS 

categories used by the teacher (19 possible). 

(e) Question Success : The percentage of all questions which 

result in designated and independent pupil responses. 

(f) Reaction Quality : The average level of teacher reaction to 

pupil responses. Weights are assigned to reaction categories : ACC *+l 
CRIT 3; REJ • -1; APP * +3; NOEV ** 0. The frequency of 
events in each category is multiplied by its weight. The 
resulting products are added and an arithmetic mean calcu- 
lated. The resultant mean is the score for Reaction Quality. 
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As in any system designed to record classroom ve* bal behaviors 
the categories of the QSOS do not attempt to describe all the possible 
elements of the questioning strategy* The QSOS categories, however, 
do provide a basis for comparisons between teachers and/or groups of 
teachers . 

The relationships between the seven measures derived from this 
version of the QSOS were determined in one research study (Morse, 
1969). Observations, using audio tape recordings, were made of the 
teaching behaviors in a Teaching Laboratory of 86 beginning teacher 
candidates. After scores were derived £o* ?ach subject, a correlation 
matrix (see Table 1) was computed to display the relationship between 
the seven measures • 

The several measures appear highly related, for the most part. 
Most are, in fact, comprised of pinilar items. Question success, 
of all seven measures, seems to be independent; its items are not 
Included in another measure. Even though most of the measures are 
not statistically independent, their relationships are quite low. 

For exploratory studies, the present measures appear useful. Other 
measures, leua dependent, should be developed and tested. 
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Observe Training and Reliability 

Observer? heve been trained to use the QSQS in some 15 hours 
over a one-week period of time. Understanding the category definitions 
was a first step* Classification of definitions , in group discussion, 
was held prior to additional clarification while listening to practice 
audip : tapes. Additional sessions recording QSOS behaviors using 
audio tapes of recorded classroom lessons were held; records were 
compared and further clarification reached* Inter-observer reliability 
coefficients over a training tape ranged from *66 to .74 over all 
QSOS categories* One explanation of the low coefficients is the 
difficulty experienced by observers in differentiating the cognitive 
categories of KNOW (knowledge) and OOMP (comprehension), the most 
frequently used cognitive categories For the seven derived measures, 
reliability coefficients ranged from .91 to *94* 
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QUESTIONING STRATEGIES OBSERVATION SYSTEM 



Teacher ' T each P ete 

Subject E lapsed Time ‘ C oder 
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1. Question Quantity 

2. Cognitive Quantity 

3. Cognitive Quality 

4. Tactical Versatility 



S. Question Success 

) 

Reaction Quality 
?. Cognitive Versatility 




APPENDIX B 

Sample Tape-Recorded Transcript Coded Using 
Questioning Strategies Observation System (QSOS) 



Statements 



Code 



Ts This is a discussion on the Magna Charts and its implications 
on how Its affected the development of way ♦•he United States 
government and what it has done to further civil rights* 

After the battle of Runnymede in England the English Barons 
forced King John to sign the Magna Charts and in the Magna 
Charts these Barons demanded civil rights* They demanded 
that the King listen to what they wanted and respect their 
rights as individual people Instead of having the government 
function entirely for the benefit of the state but it should 
benefit for the good of the people as well. This was the 
first document of its kind and it was really the beginning of 
individual rights* It started government for the people and 
by the people Instead of government Just for the good of 
the state. O.K. Can someone tell me why this was important 
to the development of late democratic governments? Billy? GOES 



Billy: Could you repeat the question please? 

T: Why was this important to the later development of 



COMP 

ABT 



democratic governments? 



IDES 

COMP 

NOR 



Si (No response*) 



T: Well, without this the later governments wouldn’t have 

had any individual rights provided. Like for instance 
what in our constitution gives this individual rights, 
this civil rights to people? 



NDES 



KNOW 



S: The Bill of Rights? 

T: Uh huh, and like when the constituion of the United 

States was being ratified a lot of the states objected 
to the original constitution because it didn't have a 
bill of rights and they wouldn't accept our constitution 
until a bill of rights was added. So this shows you that 
it '8 a major part of our government and this is one of 
the major areas of conflict in government in the United 
States is civil rights because people, some of these 
individual groups feel that they don't have these rights. 
Would you say that this would serve to limit the powers 
of the government? Linda? 

Linda r I think it would limit the powers of the government 
to some extent that's what the people want too. You're 
talking about the Bill of Rights? 

T: Yes, just civil rights in general. Like for Instance, 

what would the United States be like without divil 
rights? 

Linda: Well everybody would he very discontented. 

Everybody fee’s like they want part, not have just one 
person have complete control. And this gives people 
more say in what they're doing. 

Tt Yes , and without civil rights we would more or less have 
a totalitarian government where the government would 
control what you think and what you say and everything 
you do more or less, without these civil rights. 

S s Either that or this particular government would not have 
lasted as long as it has. 

X: Yes that's true. But would you say that civil rights 

actually would limit the power of government? 

S: Yes, I think so. 



IND 

ACC 



GDES 

ANAL 

DES 



ACC 

PROB 

APPL 



ACC 



IDES 

COMP 

DES 
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T; I think it does. Because without the civil rights the ACC 

government could just completely run over the people 
and do whatever it wanted. Why was, say, there Articles 
of Confederation in the United States. One of the major 



reasons it failed was h ec *use it didn't provide as much 
in the way of civil rights as the people felt was 
necessary. What are some other ways that civil rights 
are guaranteed in the United States? NDES 

S: You mean besides the Bill of Rights? IND 

T: Uh huh. Acc 

PROB 

KNOW 

§: You mean their power of government or something? DES 

T: Yes. This is one way that we exercise our civil rights, ACC 

by voting and by electing the people that represent us 



and these civil rights are alsp protected in some of the 
other amendments, like for example, the states have many 
rights which aren't delegated to the national government. 

And this is in a way a civil right because -- ah, what 
the constitution in effect says is that the national govern- 
ment has the power specifically given to it. Of course it 
has the implied powers too. But the powers which don't 
belong to the United States government belong to the people, 
like we give the government certain powers and whatever is 
left over is ours and they can't take that away from us -- 
unless they do something to change it. The Magna Charta 
was the first document that actually guaranteed any civil 
rights to the people, the people demanded that this be done 
and this was a major limitation on the powers of the monarchy 
in England because the people demanded that the government 
couldn't just do anything they wanted without consulting the 
people. How would the government have developed differently 

if the people hadn't demanded this, these civil rights? Billy? 

GDES 
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Billy: Well, it would have been a totalitarian state where 

people wouldn't have had any voice at all in their 
government and they would be Just like puppets and have 
to do everything the government said. DES 

T: That's right. What-say take the major objectives of 

cur government and the major objectives of a totalitarian APP 
government and what is the difference? PROB 

COMP 

Billy: We have more voice in our government and can pick DES 



who we want to run our government -- we vote in the 
laws that we want to run our nation. 

T: That's right. And we run our government rather than the 

government running us. Does the Bill of Rights guarantee ACC 
Just rights to individual people or does it say protect NDES 

your rights in courts of laws too? COMP 

S: It protects your rights in a court of law so you can 

gut a speedy trial IND 

T: And it says that you’re innocent until you're proven 

guilty rather than being the other way around. This NOEV 

guarantees that you have to have a fair trial and fair 
representation and a Jury of people to Judge you not 
Just one person that passes Judgment on you. And it 
guarantees you someone to represent you, a lawyer. It 
protects you from being put in Jail without any reason, 
like they have to make a charge against you and they can't 
forbid you bail except in certain cases. 

S: About the confederation -- didn't it have some kind of 

provisions, like being protected in a court of law and 
things like this or did it not? 

T: I think it did -- like the Articles of Confederation it was 

n bunch of separate states. 

End of Tape 
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